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[57] ABSTRACT 

A correlation tracker for generating correlation error 
tracking signals over an entire video frame. Video infor- 


mation from a scanning receiver is inputted into the 
correlation tracker in serial form. The correlation 


(75] Inventor: 
[73] Assignee: 





tracker first incorporates apparatus to generate a refer- 
ence map in pixel format. Reference map pixel informa- 
tion for one video frame plus one video line is stored in 
a memory to allow the calculation of azimuth and eleva- 
tion optimal weighting values for each pixel in the field 
of view. Each video pixel of data being received during 
the current frame is then summed with the correspond- 
ing reference map pixel from the prior frame and the 
result multiplied by the appropriate weighting function. 
Each resultant product is then combined in an accumu- 
lator to form azimuth and elevation correlation error 
signals which are composite indications of the frame-to- 
frame correlation over the entire field of view. The 
weighting factors for each pixel are also combined and 
accumulatively added over the entire image plane to 
form three adaptive scale factors at the end of each 
frame whicli are combined with the azimuth and eleva- 
tion correlation error signals to eliminate cross-cou- 
pling and generate cross-coupling-free correlation error 
signals. Drift compensation may also be provided by 
combining the adaptive scale factors and several prede- 
termined constants to recursively calculate a drift cor- 
rection which when combined with the cross-coupling- 
free correlation error signals generates drift-free corre- 
lation error signals. 


27 Claims, 6 Drawing Figures 
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VIDEO CORRELATION TRACKER 


BACKGROUND OF THE INVENTION 


The present invention relates to trackers and particu- 
larly to correlation. trackers whereby correlation error 
signals are generated which are indicative of the frame- 
to-frame correlation of a particular scanned scene. 

In general, the correlation tracking concept involves 
the generation of a cross-correlation function between a 
stored scene and currently measured scene in which the 
location of the peak is a measure of the image shift (i.e. 
the tracking errors). However, if such an approach is 
followed literally, the operation of systems in which the 
field of view (FOV) is sampled could be seriously im- 
paired because the correlation between a reference map 
(preferably generated from an averaging of past sample 
scenes) and a currently sampled scene will always result 
in a signal with its peak occurring at discrete values of 
the resolution elements (i.e. pixels) in the FOV. Clearly, 
if tracking accuracies several orders of magnitude less 
than the resolution capability are required, inferior 
tracking could result using a correlation tracker that 
relies on correlation peak information. 

Conventional methods for obtaining elevation and 
azimuth tracking error signals (Se and dd respectively) 
from video data include edge tracking and centroid 
tracking processes. In the case of a centroid tracker for 
example, azimuth and elevation weighting functions are 
essentially stored ramp signals. In order to limit back- 
ground noise levels, a gating control is often provided 
to truncate the weighting functions to zero outside the 
field of view of the gate. Threshold circuits can also 
reduce the effect of background noise. Attempts are 
often made to select the gate sizes and threshold levels 
automatically in order to give an adaptive capability to 
the tracking system. However, even if such a selection 
could be done in some optimal fashion, it can be shown 
that the correlation tracker of the present invention will 
always yield less noisy tracking error signals. Conse- 
quently, the advantages of the correlation tracker of the 
present invention become most apparent for low signal- 
to-noise ratios (SNR), i.e., SNR’s less than ten, for ex- 
ample. 

Systems have also been implemented to perform a 
correlation tracking function through the use of optics, 
photographic transparencies, etc. However, such sys- 
tems have limited flexibility for changing targets. Sug- 
gestions have also been promulgated supporting the 
utilization of digital processing techniques. However, 
the primary reason that such digital processing has not 
been developed for a correlation tracker operation has 
been the inability to efficiently process and use the re- 
sultant large amounts of video data. Furthermore, the 
data rates are often too fast for digital computers to be 
used in a real time operation. 

The video correlation tracker of the present inven- 
tion circumvents these significant problems in making 
efficient use of large amounts of data by generating and 
utilizing near optimal adaptive weighting functions. In 
theory, it has been demonstrated that the correlation 
tracker of the present invention has the capability of 
responding to targets with changing sizes and aspect 
angles for bandwidths less than w; = w1/T, where T is 
the frame time for the field of view and w; is the 
weighting parameter for the current scene in a refer- 
ence map averaging process. 


5 


40 


45 


50 


55 


60 


65 


2 


SUMMARY OF THE INVENTION 


A frame of video from a TV-like imaging sensor and 
multiplexer occurs at time increments which may be 
denoted as 1, 2,...k, k + 1... where the time interval 
to scan a frame of video, T, is typically 1/60 of a second. 
Each frame of video then contains an image which after 
digitization consists of an array of pixels (or resolution 
elements) which number Ne in elevation (vertical) and 
Nd in azimuth (horizontal). Typically Ne and Nd each 
have values of several hundred so that the total array 
contains on the order of 104 to 105 pixels. A pixel at the 
i,j position in the array (i = vertical, J = horizontal) is 
represented by a voltage or intensity level of Vk) for 
frame k. At the end of each video frame, the optimal 
(least noise) correlation tracking signals for the vertical 
and horizontal directions can be determined from V {k) 
utilizing apparatus in accordance with the principles of 
the present invention. 

Thus, a correlation tracker for generating correlation 
tracking error signals is first characterized as having a 
receiver for receiving radar, infrared or other electro- 
magnetic energy from an observed scene to form a 
plurality of video signals V;{k) which may be combined 
in serial form to sequentially energize individual pixels 
in the image plane of a display to thereby generate a 
video frame of the observed FOV scene. This serial 
video signal is converted to a digital format in an A/D 
converter in the preferred embodiment. 

The video information is then first used to form a 
stored reference map having a plurality of pixels each 
representing some functional average of the corre- 
sponding video pixels from a plurality of previously 
generated FOV frames. Inherent in this reference map 
generator is a memory capable of storing at least one 
frame plus one line of the immediately preceding refer- 
ence map pixels. 

A weighting function generator is then coupled to the 
map generator in order to generate both an elevation 
and azimuth weighting function value for each refer- 
ence map pixel. These weighting functions are essen- 
tially derivatives of the signal value for each pixel in 
orthogonal directions. Consequently, the derivatives 
may be generated by simply differencing the signal 
value of adjacent pixels on either side of the pixel in 
question in the direction for which the derivative is 
sought and dividing by the physical length over which 
the derivative is taken. 

A scale factor generator is also provided to receive 
the weighting functions and generate adaptive scale 
factors which are the negative of the second derivative 
of the crosscorrelation function in and between the 
coordinate directions of the observation scene video 
and the reference map. 

A correlation error generator is next coupled to re- 
ceive the weighting functions and the corresponding 
pixel values of the reference map and current video 
pixel data to form a preliminary correlation error value 
in both the azimuth and elevation direction for each 
pixel. These preliminary correlation error values are 
summed during the frame scan time over the total num- 
ber of pixels (ie., Ne Nd pixels) and the result di- 
vided by the appropriate adaptive scale factor to gener- 
ate an azimuth correlation error value and elevation 
correlation error value for each video frame by the end 
of the video frame. These error values are outputted at 
the end of each video frame, preferably during the 
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frame retrace time before the video data for the next 
frame commences to be received. 

A normalized error value generator may also be pro- 
vided to couple the adaptive scale factors and the corre- 
lation error signals to form an azimuth normalized error 
value and an elevation normalized error value free of 
cross-coupling. 

Because operation of the present invention will gen- 
erally not be for the ideal reference map case causing 
the normalized error values to include errors due to 
drift, a drift compensator is coupled to the output of the 
normalized error signal generator whereby drift com- 
pensation values are recursively calculated and summed 
to the normalized error values in-such a way to generate 
the desired drift-free correlation tracker error signal for 
both elevation and azimuth. 

It is thus one object of the present invention to pro- 
vide a correlation tracker. 

It is another object of the present invention to pro- 
vide a correlation tracker which provides tracking 
error signals having substantially reduced noise corrup- 
tion. 

It is still another object of the present invention to 
provide a correlation tracker which can make efficient 
use of a large amount of video data. 

Still another object of the present invention is to 
provide a correlation tracker whereby optimal adaptive 
weighting functions are generated and utilized. 

Yet another object of the present invention is to pro- 
vide a greatly simplified correlation tracker. 


BRIEF DESCRIPTION OF THE DRAWINGS 


These and other objects, features and advantages of 
the invention as well as the invention itself will become 
more apparent to those skilled in the art in light of the 
following detailed description taken in consideration 
with the accompanying drawings where like reference 
numerals indicate like or corresponding parts through- 
out the several views wherein: 

FIG. 1a is a representation of an image plane for the 
display of imaging sensor video in pixel array format. 

FIG. 10 is a representation of a typical video signal 
having a plurality of segments each representing the 
signal value utilized to energize one pixel in the pixel 
array illustrated in FIG. 1a. 

FIGS. 2a and 20 illustrate a detailed block diagram of 
a correlation tracker in accordance with the present 
invention. 

FIG. 3 illustrates one possible implementation of the 
accumulative adder and sample and hold portions of the 
correlation tracker illustrated in FIG. 2. 

FIG. 4 is a representative timing diagram illustrating 
the operation of the accumulative adder and sample and 
hold implementation illustrated in FIG. 3. 


DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENTS 


The correlation tracker apparatus and method of the 
present invention is particularly applicable in systems 


such as television, certain radar systems, or infrared 60 


imaging systems in which the FOV (field-of-view) is 
scanned and data therefrom is encoded into a video 
signal format. The resultant video signal may be ulti- 
mately used to sequentially energize a plurality of pixels 
in an image plane of a display viewed by an operator. In 
an infrared system, for example, a finite array of infra- 
red detectors may be positioned in a single vertical row 
which is swept across the FOV. The output from the 
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plurality of infrared detectors may be periodically sam- 
pled and then multiplexed to produce a single compos- 
ite video signal which is comprised of a series of sequen- 
tial samples each representing the magnitude of the 
infrared electromagnetic radiation from a small region 
in the FOV. An example of such a receiving technique 
incorporating sampling and multiplexing is illustrated in 
pending application Ser. No. 841,581, filed Oct. 13, 
1977. In another type of infrared system a storing array 
of sensors receive data from the FOV and the data may 
be periodically multiplexed into a series of video signals. 

A representative image plane in pixel array format 
having an elevation coordinate € and azimuth coordi- 
nate 7 is illustrated in FIG. 1a. It will be understood 
that the image plane described represents the organiza- 
tion for both the video signal V,{k) and the reference 
map memory as well as the image plane of an actual 
display 205. However, the reference map pixel data 
stored need not be actually displayed. It will also be 
appreciated that the pixel dimensions hereafter de- 
scribed are for a given actual display image plane. Each 
pixel P;{k) of a representative display image plane is 
energized once during each frame k by the correspond- 
ing appropriate video signal Vik). The speed at which 
the individual pixels are energized and the presistence 
qualities of the pixels once energized can be utilized to 
permit a frame of video to be displayed. For purposes of 
explanation hereafter, the image plane will be under- 
stood to have Ne rows of pixels and Nd columns of 
pixels where each pixel has a physical dimension Ae in 
the € coordinate direction and a physical dimension Ad 
in the 7 coordinate direction. Each pixel is then ener- 
gized for AT seconds with a row of pixels (i.e. Nd pix- 
els) being energized in DT seconds. Furthermore, the 
scanning convention adopted for the explanation of the 
present invention will be to energize each pixel of the 
image plane individually in the horizontal direction 
along coordinate n with each row being sequentially. 
energized in the negative € coordinate direction. Thus, 
from FIG. 1a, pixel P;, will be energized first, pixel P,2 
will be energized second and so forth until pixel Pye, va 
is energized last. Of course, it will be appreciated that 
any scanning pattern of the receiver and any image 
plane energizing sequence may be implemented without 
departing from the present invention so long as the 
sequence of energizing the image plane pixel array is 
known. Further, it will be obvious to those skilled in the 
art that variations in the scanning pattern may require 
appropriate sign changes in various terms of the hereaf- 
ter described equations. 

Referring now to FIG. 18, a representative video 
signal v(t) is shown having a plurality of components 
V fk) each with a magnitude proportional to the inten- 
sity of the electromagnetic radiation received by the 
system sensors in the receiver scanning process. The 
video signal v(t) is organized in accordance with the 
previously described image plane pixel array organiza- 
tion to thereby allow the video signal v(t) to energize 
the display image plane illustrated in FIG. 1¢. Thus, 
each video signal component Vj; persists for a time AT 
with the time necessary to energize an entire row of 
pixels designated as DT. In addition, between energiz- 
ing pixel P; vq and pixel P,, 1,1 a line retrace time, t;, is 
required to allow the scanning beam of the display to be 
repositioned to the beginning of the next line. Such a 
line retrace time t;occurs at the end of the scan time for 
each row and continues until the end of the frame writ- 
ing time T at which time a frame retrace time tyis re- 
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quired to allows the scanning beam of the display to 
return to pixel P;; from pixel Pxy,vp. In general, the 
frame retrace time will be somewhat longer than the 
line retrace time. Of course, it will be appreciated that 
various scanning techniques may be utilized to minimize 
the line retrace time or the frame retrace time without 
departing from the teaching of the present invention. 
Once frame k has been generated on the image plane 
and the frame retrace time has occurred, the next image 
plane frame k+1 is written on the display image plane 
by repeating the process previously described. 

As indicated above, it is essential in many systems to 
provide a high degree of stability for the display from 
frame to frame to not only prevent display jitter and 
other such abnormalities but to permit the location of 
features in the image plane to an accuracy greater than 
the size of the individual pixels. The generation of error 
signals which may be utilized in a feedback configura- 
tion is one way to provide these characteristics. 

Referring now to FIGS. 2a and 28, a representative 
correlation tracker 200 in accordance with the teach- 
ings of the present invention is illustrated. Initially, a 
FOV scene 202 is scanned by a scene signal receiver 204 
which may be a radar receiver, an infrared receiver or 
any electromagnetic signal receiver. The receiver 204 
senses electromagnetic radiation from the FOV scene 
202 and generates a video signal v(t) according to a 
particular format such as the format of the video signal 
illustrated in FIG. 10. In the preferred digital embodi- 
ment of the present invention, the individual compo- 
nents of the video signal Vy are first converted to a 
digital number representation in an A to D converter 
206 to form a digitized video signal v(t) comprised of a 
stream of digital numbers V;{k) for each frame k of a 
display image plane. 

In accordance with the preferred embodiment of the 
present invention, a reference map is first generated 
according to the relation 


MAP fk) = (1—w1) MAP,{k—1) + 4 Vik) 


where wy is a reference map weighting function having 
a value 0 S w; = 1 and where vw is preferably chosen 
as the reciprocal of the number of frames of video infor- 
mation over which the generated reference map pixel 
values are determined. Consequently, if features in the 
map are changing rapidly, it will be desirable to de- 
crease the number of frames which contribute to the 
value of the elements of the reference map by increasing 
the defined value of w). Conversely, if little movement 
or change is expected in the video received, then the 
inclusion of more frames of video information to form 
the reference map will be desirable and the defined 
value of w, will thus be decreased. In addition, it is also 
desirable to include the maximum number of video 
frames (i.e., to set w; as low as possible) in order to 
minimize the effect of any random noise which may 
exist in the video return. As an example, in relatively 
benign video scenes, acceptable results have been 
achieved utilizing 12 to 16 video frames (i.e. setting w; 
= 0.06 — 0.08) while for dynamic video scenes success- 
ful results have been achieved utilizing about 5 video 
frames (i.e. setting w; = 0.2). It may also be desirable to 
periodically reset the value of w, during operation of 
the tracker to more accurately reflect the dynamics of a 
FOV while it is being observed. 

Because the reference map for any given frame k is 
dependent on both the current data V,;(k) and the value 
of the reference map MAP,{k—1) for the previous 
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video frame k—1, it is necessary in the preferred em- 
bodiment to provide some means of storing at least one 
frame of MAP, data. This storage is preferably done 
according an organization directly analogous to: the 
organization of the display image plane. Although it is 
preferable to compute the reference map according to 
this technique, it will be appreciated that a constant 
reference map may be defined or an open loop method 
may be employed without departing from the teachings 
of the present invention so long as a reference map is 
provided which is representative of the previously re- 
ceived video signals. 

Referring now principally to FIG. 2a, a map genera- 
tor 208 is illustrated whereby video information Vk) 
for each pixel P;{k) is first multiplied in a w; multiplier 
‘210 to obtain the product w)*V; i(k). This product is 
then added to the corresponding map pixel value MA- 
P;{k— 1) which has been stored from the calculations in 
the previous video frame and multiplied in a second 
multiplier 212 by 1—w,. The two above-described 
products are then summed in a first summer 214 to yield 
a series of reference map pixel values having the same 
output format as the digitized video input V;{k). 

The resultant map MAP,{k) for frame K is then 
stored. This storage may be accomplished using a ran- 
dom access memory 340 (represented as a dashed line 
about the next to be described shift register embodi- 
ment) or a plurality of shift registers or any other stor- 
age technique whereby at least one frame plus one line 
of digitized map pixel data can be stored. In FIG. 2a, an 
implementation is shown utilizing a series of shift regis- 
ters capable of storing and shifting multi-bit digitized 
values of MAPi(k). Thus, each value of MAP;{k) is 
stored as a digital word in a first bit region of a first shift 
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plish a delay approximately equal to T-DT (i.e., capable 
of storing and serially shifting (Ne—1) x Nd words of 
MAP; pixel data). As each delayed value of the map 
occurs in the last bit region of the first shift register 216, 
it is input into a second shift register 218 would delays 
each pixel value of MAP; for a time approximately 
equal to DT-AT seconds by a shifting process identical 
to that of the first shift register 216. In order to accom- 
plish a shift delay for this length of time, the second shift 
register 218 must have Nd—! reference map pixel word 
storage locations. Finally, the resultant map, delayed 
exactly one video frame, is obtained by incorporating a 
third shift register 220 which delays each map pixel 
word by a time AT. The third pixel word shift Sema 
thus stores only one map pixel word. 

Although reference has not been made to the inclu- 
sion of the line retrace time t;or the frame retrace time 
tin the above-mentioned delay process, it will be appre- 
ciated that if the shifting in the various shift registers 
216, 218 and 220 occurs in response to a clock which 
occurs only when each new digital video word V; is 
outputted from the A to D converter 206, the additional 
retrace times will be inherently included. 

In accordance with the above description, if MA- 
P;{k) data is being input to the first register, then MA- 
P;_ 1, fk—1) data will be output from the first shift regis- 
ter 216 and input to the second shift register 218 while 
the output of the second register 218 will be MA- 
P,;—1(k—1) data and the output of the third shift regis- 
ter 220 will be MAP,{k— 1). 

In order to begin the recursive computation of 
MAP,, it is necessary to define a value for the initial 
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MAP,{0). This initial map may be generated in a num- 
ber of ways. For example, the initial frame of video 
information may be defined as the initial value of the 
map, i.e., MAP,{0) = Y,{0) with tracking commencing 
with the next frame of video information defined to be 
frame k= 1. This method can be implemented by simply 
inhibiting the computation of error values during the 
initial frame, k=0, of video utilizing a switch apparatus 
224, for example, after a second summer 222. Alterna- 
tively, initial MAP,({0) may be generated by operating 
the recursive map generator 208 with the first several 
frames of video information before beginning to com- 
pute correlation tracker error signals utilizing the re- 
mainder of the apparatus. Such. an initialization tech- 
nique may be implemented by incorporating a swich 
224 at the series of AND gates (not shown) having an 
enable signal which enables the output from summer 
222, is then enabled or closed at a later time which may, 
for example, be any time greater than k= 1 i.e., after the 
first frame of video is received. This initialization tech- 
nique may be described by the equation 


MAP,{k) = (1—)) MAP; (k—1) + #4 Vifk) 


for k=1to k = 1/w,. When k = 1/Nj, switch 224 then 
closes to enable the remainder of the system to operate. 
Various other initialization techniques may also be uti- 
lized without departing from the teachings of the pres- 
ent invention. 

The reference map generator 208 also incorporates a 
fourth shift register 228 coupled to the output of the 
first shift register 216. The fourth shift register 228 is 
comprised of 2 x Nd reference map pixel word storage 
locations so that the pixel data word input to the fourth 
shift register 228 will be delayed approximately 2 x DT 
seconds. Consequently, the output of the fourth delay 
shift register 228 will be MAP;, 1, {k—1) when the out- 
put of the first shift register 216 has the value for MA- 
P;_1,Ak— 1) and the input video data is V jk). 

Finally, the reference map generator includes a fifth 
shift register delay 232 having two reference map pixel 
word storage locations coupled to the output of the 
second shift register 218 to delay the output of the sec- 
ond shift register 218 by an amount substantially equal 
to 2 x AT seconds and thereby provide the digital 
value of MAP,,,;(k—1) at the same time that the sec- 
ond shift register 218 has the value for MAP; ;_; (k—1) 
at its output. 

The output of the first, second, fourth and fifth shift 
registers 216, 218, 228 and 232 respectively are then 
inputted to a weighting function generator 226 which 
generates approximations to the negative derivatives at 
each pixel location in orthogonal directions along coor- 
dinates € and 4 respectively. Such derivative approxi- 
mations may be computed according to the relations 


MAP;.1,fk—1)—MAP,_1fk—1) 


Wek) = 2Ae 


—MAP, ,.. (kK—1)+MAP; ;_ (K—-1 
Waifk) = Bit 1¢ Oa af 16 ) 


where Ad and Ae are the physical dimensions of each 
pixel of the image plane utilized in the azimuth and 
elevation directions respectively. 

The term MAP;_1,k—1) is always available at the 
output of the first shift register 216. Similarly, MA- 
P,;-1k—1) is always available at the output of the 
second shift register 218, MAP;+1,(k—1) is always 
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available at the output of the fourth delay shift register 
228 and MAP; +. (k—1) is always available at the out- 
put of the fifth delay shift register 232. The digital value 
at the output of the first shift register 216 may then be 
subtracted from the digital value at the output of the 
fourth shift register 228 in a third summer 230. The 
output of the third summer is coupled to the dividend 
input of a first weighting function divider 231 whose 
division input is coupled to a ROM or other storage 
means 334 where the constant 2*Ae is stored to thereby 
generate the weighting function We;{k) at the output of 
the divider 234. 

Similarly, the derivative approximation Wd,{k) along 
the 7» coordinate may be generated by subtracting the 
output of the second shift register 218 from the output 
of the fifth shift register 232 in a fourth summer 234 
whose output is coupled to the dividend input of a sec- 
ond weighting function divider 235. The divisor input 
of the second divider 231 is coupled to a second ROM 
or other storage means 322 where the constant 2*Ad is 
stored to thereby generate the weighting function 
Wad,Ak) at the output of the divider 235. 

If the derivatives of a pixel along an edge of the pixel 
array are required, it will be recognized that the next 
adjacent pixel may not exist, thus preventing the gener- 
ation of W, and W, for those pixels in the above way. 
This problem may be solved in several ways. For exam- 
ple, the pixel array used for tracking in accordance with 
the present invention may be shrunk by two pixels in 
azimuth and elevation to provide a one pixel wide “bor- 
der”. Thus, correlation tracking will occur over the 
pixel array P, j to Pwe—1)j in elevation and P;2 to 
Pi~nd—1) in azimuth. Alternatively, since consistency 
rather than accuracy is the desired quality along the 
edges, the entire array may be utilized with each re- 
quired “pixel” for which data is not available set to 
zero. Thus, Voj = Vne+1j = 0 for all j and Vio = 
Vind+1 = 0 for all i. 

In accordance with the present invention, initial cor- 
relation error signals Ee(k) + Ed(k) are generated in a 
correlation error signal generator 236.in accordance 
with the relationships 


Ne Nd 

Bere) = (2) 2, Wefh) (V0) — MAPK) 
_ Fet(k) 
Ek) = “Cah 
Ne Nd 

N Ed*(k) = joa jaa Wa jfk) [Vifk) - MAP {k—1)] 

Ed*(k 
Balt) = “Gi 


where Ce(k) and Cd(k) are adaptive scale factors frém 
a scale factor generator 264 to be described subse- 
quently. Thus, the coupled correlation error signals 
Ee(k) and Ed(k) for frame k represent the weighted 
difference between the digitized video signal and the 
corresponding reference map for each pixel with the 
weighed difference summed over all pixels i n the image 
plane and divided by an appropriate adaptive scale 
factor. 

In order to generate the error value V;k)- 
—MAP;{k—1) for each pixel, the output of the third 
shift register 220 representing MAP;{k—1) is sub- 
tracted from the current video signal V{k) in the sec- 
ond summer 222. The result for pixel Py is then multi- 
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plied in a third multiplier 238 (when the switch 224 
previously described is closed) by weighting function 
Wd,{k) from the second divider 235 with the resultant 
output Wd,{k) [V;{k)— MAP,{k—1)] coupled to a first 
accumulative adder 240. 

The output of the second summer 222 is also coupled 
through the switch 224 to one input of a fourth multi- 
plier 242 whose second input is coupled to the output of 
the first divider 231 where weighting function We;{k) is 


available so that the product We,{k) [V;Ak)—MAP,k)] 1° 


is generated at the output of the fourth multiplier 242. 
This fourth multiplier output is coupled to a second 
accumulative adder 244. The outputs for each pixel 
generated by the third and fourth multipliers 238 and 
242, are summed over all Ne X Nd pixel elements for an 
entire video frame in the first and second accumulative 
adders 249 and 244 respectively. 

At the end of the video frame and preferably during 
the frame retrace time tr(see FIG. 1a), a first switching 
apparatus 246 coupled to the first accumulative adder 
249 is closed to transfer the accumulated value Ed* (k) 
to a hold register 248. At the same time, a second switch 
apparatus 250 is coupled to the second accumulative 
adder 244 to transfer the accumulated value in the sec- 
ond accumulative adder 244 to a second hold register 
252. Thus, the value transferred to the first hold register 
248 during the frame retrace time is the value Ed* (k) 
accumulated during the time that frame k was being 
formed and the value transferred to the second hold 
register 252 during the frame retrace time is the value 
Ee* (k) accumulated during the time that frame k was 
being formed. 

The output from the hold register 248 is next coupled 


to the dividend input of a third divider 284 whose divi- 35 


sor input is coupled to the Cd(k) output of the scale 
factor generator 264 to thereby generate an azimuth 
error value Ed(k) over at the end of each video frame k. 
The output from the hold register 252 is also coupled to 


the dividend input of a fourth divider 283 whose divi- 49 


sion input is coupled to the Ce(k) output of the scale 
factor generator 264 to thereby generate an elevation 
error value Ee(k) once at the end of each video frame k. 

The accumulative adder, switch apparatus and hold 


register referred to above for Ee(k) and Ed(k) may be 45 


implemented as shown in FIG. 3. In accordance with 
FIG. 3, N-bit digital words are sequentially inputted to 
an N-bit adder 410 from, for example, second or fourth 
multipliers 238 or 242 (FIG. 2a) where each such word 


value is added to the results stored in a sum register 412. 59 


The resultant sum is then stored in the sum register 412 
and is added to the next N-bit word received by the 
adder 410. This sequence continues for each pixel in the 
video frame. During the frame retrace time, an enable 


signal (see FIG. 4) is generated and coupled to a plural- 55 


ity of AND gates 414 comprising the switch apparatus, 
represented, for example, by switches 246 and 250 in 
FIG. 2a, whereby one AND gate input is coupled to 
one sum register output. Thus, when the enable signal 


occurs, the accumulated value held in the sum register 60 


at the end of each video frame k will be transferred 
through the switch apparatus 414 to an N-bit hold regis- 
ter 416. Of course, it will be appreciated that many 
other accumulative adding and sampling techniques 


may be devised and that it will be possible in some 65 


embodiments to eliminate the hold register 416 if subse- 
quent calculations are completed immediately during 
the frame retrace time. 
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10 
The present invention also incorporates a scale factor 
generator 264 to generate adaptive scale factors to pro- 
vide the correlation error signals in accordance with the 
teachings of the present invention. These adaptive scale 


5 factors Ce(k) + Cd(k) are defined to be the negative of 


the second derivative of the cross correlation function 
between the reference map and the scene in the € and n 
coordinate directions as defined in FIG. 1a respec- 
tively. It can be shown that these adaptive scale factors 
may be generated according to the relationships: 


d 2, 
Chk) = = 2 Wek) 
Ne 2 
CAR) = 21 2 Wah. 
i= 


In addition, the resulting correlation error values Ee(k) 
+ Ed(k) may incorporate undesirable cross-coupling 


0 which may be removed utilizing the cross-coupling 


scale factor Ced(k) which may be generated in the scale 
factor generator according to the relationship: 


Ne 


Nd 
Codb) = 52, ; 2 Welk) Wayfe) 


where Ced(k) is the negative of the cross partial second 
derivative of the cross correlation function between the 
reference map and the incoming scene in the € and 7 
coordinate directions. It will be appreciated that other 
methods and apparatus for defining values for Ce(k) and 
Cd(k) may be devised without departing from the 
teaching of the present invention and that cross-cou- 
pling need not necessarily be removed in all embodi- 
ments and that Ced(k) may not have to be generated. 

Referring again to FIG. 2a, adaptive scale factor 
Ce(k) may be generated by first squaring We; by cou- 
pling the output of the first divider 231 to both inputs of 
a fifth multiplier 254. The output of the fifth multiplier 
254 is then coupled to a third accumulative adder 256 
whose output is coupled to a switch apparatus 258 and 
hold register 260 in the manner previously described in 
conjunction with the generation of correlation error 
signals E(k) and E,(k). The transfer from the accumu- 
lative adder 256 to the hold register 260 will preferably 
occur during each frame retrace time and the value so 
transferred and held in the hold register 260 will be 
Ce(k). 

Similarly, Wd, is squared by coupiing the output of 
the second divider 235 to both inputs of a sixth multi- 
plier 262 whose output is coupled to a fifth accumula- 
tive adder 266 which in turn is coupled to a switch 
apparatus 268 and hold register 270 in the manner previ- 
ously described to generate the adaptive scale factor 
Cd(k) once at the end of each frame k. Finally, 
weighting function Wd,{k) is multiplied by We;,{k) in a 
sixth multiplier 272 whose inputs are respectively cou- 
pled to the second divider 235 and the first divider 231 
with the output of the sixth multiplier 272 accumula- 
tively added over all the pixels in a fourth accumulative 
adder 274. The output of the fourth accumulative adder 
274 is coupled to a fourth switching apparatus 276 and 
a fourth hold register 278 in the manner previously 
described to thereby output the adaptive cross coupling 
scale factor Ced(k) during the frame retrace time. 

Referring again to FIGS. 3 and 4, once the accumu- 
lated value over the video frame has been transferred to 
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the various hold registers or otherwise utilized as re- 
quired in subsequent calculations, an accumulator reset 
pulse may be generated by external timing circuitry (not 
shown) to reset each of the accumulative adders 240, 
244, 256, 266 and 276 to zero during the frame retrace 
time in preparation for accumulating the data for the 
next video frame. 

Correlation error signals free of cross-coupling for 
both the elevation and azimuth channels are next calcu- 
lated in a normalized error signal generator 280 accord- 
ing to the relations 


&e’ = ; mae Ee 
Ceca 
where 
- 2 Ced(k 
Ee’ (ky = (Beth) - ZEA Batty 
and 
re ea 
bd = 8 Ed 
“Ceca 
Ced(k 
Ed’ (k) = Ed(k) = Sa Ee(k) 


Referring to FIG. 2b, the cross-coupling-free or nor- 
malized correlation error values Se’(k) and 5d(k) may 
be calculated immediately upon receiving the adaptive 
scale factors for a particular frame. Thus, it is preferable 
to compute Se‘(k) and 6d’(k) during the frame retrace 
time ty As a representative example of one implementa- 
tion, Ced(k) and Ce(k), the outputs from fifth hold reg- 
ister 278 and third hold register 260, may be coupled to 
a fifth divider 302 to generate the quotient Ced(k)- 
/Ce(k) at the output of the fifth divider 302. Similarly, 
the output from the fifth hold register 278 where the 
value of Ced(k) for frame k is available and the output 
from the fourth hold register 270 where the value Cd(k) 
for frame k is available may be coupled to a sixth divider 
300 to obtain the quotient Ced(k)/Cd(k). 

The outputs of the fifth divider 302 (Ced/Cd) and the 
third divider 284 (Ed) are then coupled to the inputs of 
an eighth multiplier 290 to obtain the quotient (Ced/Cd- 
)Ed. The output of the eighth multiplier 290 is coupled 
to the minus input of a fifth summer 292 whose other 
plus input is coupled to the output of fourth divider (Ee) 
to generate the azimuth cross-coupling-free correlation 
error signal Ed’(k) at the output of the fifth summer 292. 

Similarly, the output of the sixth divider 300 
(Ced/Cd) and the output from the fourth divider 282 
(Ee) are coupled to and multiplied in a ninth multiplier 
286 whose output is coupled to the minus input of a 
sixth summer 288. The positive input of the sixth sum- 
mer 288 is coupled to the output of the third divider 284 
(Ed) to thereby subtract the output of the ninth multi- 
plier 286 from the elevation correlation error signal Ee 
and generate the elevation correlation error signal 
Ee’(k). The remaining term 1 —(Ced?/CeCd) to com- 
plete the generation of the normalized correlation error 
signals Se’ and 8d’ may be implemented as shown in 
FIG. 2b where the outputs from the fifth and sixth 
dividers 302 and 300 are coupled to and combined in a 
tenth multiplier 294 to generate the value Ced?(k)- 
/Ce(k)Cd(k). The output from the tenth multiplier 294 
is then coupled to the positive input of a seventh sum- 
mer 296 which has negative input coupled to a ROM 
(read-only-memory) or other storage device 298 con- 


15 


20 


25 


30 


35 


40 


45 


50 


55 


60 


65 


12 

taining the constant 1 to obtain the result 1 —(Ced? 
/CeCd) at the output of the seventh summer 296. The 
output of the seventh summer 296 is then coupled to the 
divisor inputs of a seventh divider 308 and an eighth 
divider 310 whose dividend inputs are respectively 
coupled to the outputs of the fifth summer and the sixth 
summer respectively to generate Se’ and dd’ respec- 
tively at the outputs of the seventh and eighth dividers 
308 and 310 respectively. 

Although the normalized correlation error signals de’ 
(k) and &d’(k) would be the desired tracking errors in an 
ideal case in which the reference map is not a function 
of past tracking errors, in reality the reference map may 
be significantly different from the ideal case because the 
reference map is in fact a function of past tracking er- 
rors. Consequently, the current tracking estimates 
Se’(k) and 8d’(k) include the effects of past tracking 
errors. This undesirable corruption has been referred to 
as drift. However, it has been determined, in accor- 
dance with the present invention, that drift compensa- 
tion can be incorporated to generate drift-free correla- 
tion error signals 5d,,,,in azimuth and 5e,,,,in elevation 
for each time frame k according to the relationships: 


BecorAk) = [8a' (k) + dpR(h)] 
Becordk) = (Be! (kK) + Sepp(hl 


where the drift compensation terms are calculated re- 
cursively such that 


Sepp k) = Sepr(k—1) + w8-' (K-1) 
and 


8d pr(k) = 8d pr(k—1) + w8q' (kK—-1). 


The drift compensation terms 5epr(k) and Sdpr(k) 
may be generated in a drift compensation means 331 
utilizing the drift compensation terms S5epr(k—1) and 
8d pr(k—1) and the normalized error values Se’ (k—1) 
and 6d’(k—1) from the previous video frame k—1. 
Thus, in frame k the drift compensation terms and 
Seppr’(k) and 8dppr’(k) are computed and held for use in 
the next frame k+ 1. This function may be performed to 
generate Se,,,,(k) by coupling the output from the sev- 
enth divider 308 (Se’ (k)) to a first drift multiplier 312 
where Se’ (k) is multiplied by w; where w, is a constant 
whose value is defined as previously described. The 
value of w; may be input from an external ROM indi- 
cated as box 313 or any other storage means. The output 
of the first drift multiplier 312 is coupled to one input of 
an eighth summer 314 whose output is coupled to a sixth 
sampling means 316 which may be a series of AND 
gates enabled once during each frame retrace time in 
the manner previously described in conjunction with 
FIGS. 3 and 4. The result is then held in a sixth hold 
register 318 for at least one frame time T. The output of 
the sixth hold register 318 for frame k is 5epr(k) which 
is coupled in a closed loop positive feedback manner to 
the second input of the eighth summer 314 so that the 
value at the output of the eighth summer 314 during 
frame k is the elevation drift compensation term for 
frame k+1 i.e., Sepr(k+1). The output of the sixth 
hold register 318 is also coupled to one input of a ninth 
summer 320 whose other input is coupled to the output 
of the third divider to thereby generate the sum 6d’(k) 
+8dpr(k) at the output of the ninth summer 320 to 
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produce the desired drift compensated correlation error 
signal 8d,9,k). 

Similarly, in the azimuth channel, the output from the 
ninth divider 310 is coupled to a second drift multiplier 
324 and to the ROM 313 to generate the term 
w,*5d'(k). The output of the fourth constant multiplier 
324 is coupled to the input of a tenth summer 326 whose 
output is in turn coupled to a seventh switch apparatus 
328 which may be a series of AND gates periodically 
enabled during the frame retrace time to thereby trans- 


fer the result from the tenth summer 326 to a seventh: 


hold register 330. The value held at the output of the 
seventh hold register 330 is thus 6dpr(k) which is cou- 
pled to the second input of the tenth summer 326 so that 
the value 5dpr(k+1) occurs as the output of the tenth 
summer 326 during the frame retrace time at the end of 
frame k. The output Se’(k) from the eighth divider 310 
is also coupled to one input of an eleventh summer 332. 
The second input of the eleventh summer 332 is coupled 
to the output of the seventh hold register 330 to thereby 
produce the result Se’(k) + Sepr(k) = Seo,, at the 
output of the eleventh summer 332. 

The resultant correlation tracker error signals are 
useful in numerous applications including the elimina- 
tion of jitter in the display as well as for providing 
pointing accuracies which permit accurate location of 
features in the field of view observed. 

The various multipliers, dividers, registers, switching 
apparatus and summers referred to previously may be 
any of a number of conventional and available devices 
well known in the art. 

While the above description has been made with 
reference to a digital system, it will be appreciated that 
various other implementations of the basic principles of 
the present invention are possible including an analog 
implementation or a hybrid implementation. The scope 
of the invention may thus include any suitable digital or 
analog processor arrangement that incorporates the 
principles in accordance with the invention. It will also 
be appreciated that other methods may be utilized to 
generate a reference map including external generation 
without direct utilization of the video signal V;{k) and 
that orthogonal derivatives relative to a particular pixel 
may be derived in numerous other ways well known in 
the art without departing from the spirit of the present 
invention. In addition, it will be appreciated that in 
certain cases, drift removal or cross-coupling correc- 
tions may not be required and therefore drift removal 
apparatus and cross-coupling apparatus could be elimi- 
nated. 

What is claimed is: 

i. A correlation tracker for generating correlation 
tracking error signals said tracker having a receiver for 
receiving electromagnetic information from a scene to 
form an input signal having a plurality of sets of pixel 
values each set representing pixel data for one video 
frame, said correlation tracker comprising: 

(a) a reference map generator for receiving said pixel 
values and generating a reference map having a 
plurality of reference map values corresponding to 
said pixel values; 

(b) a weighting function generator coupled to said 
map generator for generating at least one 
weighting value for each pixel value; 

(c) a scale factor generator coupled to said weighting 
function generator for combining the weighting 
values to form at least one pixel correlation scale 
factor and accumulating said pixel correlation scale 
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factors to form at least one correlation scale factor 
for each video frame; and 

(d) a correlation error signal generator coupled to 

said weighting function generator, to said scale 
factor generator, and to said map generator for 
generating at least one correlation error value from 
said reference map pixel values, said input signal 
pixel values, and said weighting function for each 
pixel and accumulating a plurality of said correla- 
tion error values which is scaled by one of said 
scale factors to form at least one correlation error 
signal for each video frame. 

2. The correlation tracker of claim 1 further compris- 
ing a normalized error signal generator coupled to said 
scale factor generator and said correlation error signal. 
generator whereby the value of said correlation error 
signal generated each video frame is multiplied by a 
function of said correlation scale factors to form at least 
one normalized correlation tracking error ‘signal for 
each video frame. 

3. The correlation tracker of claim 2 further compris- 
ing a drift compensator coupled to said normalized 
error signal generator and oriented to correct said nor- 
malized video error signals for one video frame as a: 
function of the normalized video error signals from at 
least one prior video frame to generate at least one 
drift-free correlation tracker error signal for each video 
frame. 

4. A correlation tracker for generating correlation 
tracking error signals said tracker having a receiver for 
receiving electromagnetic energy from an observed 
scene and generating therefrom a video signal Vj{k) 
useful in sequentially energizing a plurality of pixels 
P,{k) on a display to sequentially form a plurality of 
frames of the observed scene thereon, said correlation 
tracker comprising: 

‘(a) a map generator for receiving said video signal 

Vk) for each pixel identified by an i location along a 
first direction and a j location along a second direction 
in each video frame k and recursively calculating a 
reference map MAP,{k) according to the relation 


MAP, k) = (1—wy)MAP,{k—1) + Vif) 


where wy is a weighting value having a value OS w,31, 
said map generator including memory means for storing 
at least one frame plus one line of MAP; pixel data; 

(b) a weighting function generator coupled to said 
map generator memory means for generating a first 
weighting function We,{k) and a second weighting 
function Wd,{k) said first weighting function being 
a measure of the negative derivative of said refer- 
ence map in said first direction and said second 
weighting function being a measure of the negative 
derivative of said reference map in said second 
direction; 

(c) a scale factor generator coupled to said weighting 
function generator for calculating a first adaptive 
scale factor Ce(k) and a second adaptive scale fac- 
tor Cd(k) for each video frame k where said first 
and second scale factors are measures of the nega- 
tive second derivative of the reference map in said 
first and second directions respectively; and 

(d) a correlation error signal generator coupled to 
said weighting function generator and to said map 
generator for generating a first correlation error 
value Ee(k) according to the relationship 
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Ne Nd 
Eet(k) = 2 F 2 Wei) (Vif) — MAP£k—1)} 


_ £Eer(k) 

EAN) = “CAh) 

and a second correlation error value Ed(k) according to 
the relationship 


Ne Nd 
Ed*(k) = 721 jel Wa fk) [ViAe) - MAP f{k—1)] 


Ed*(k 
Ed(k) = se . 

5. The correlation tracker of claim 4 wherein said 
scale factor generator further comprises means for gen- 
erating a cross-coupling scale factor Ced(k) where said 
cross-coupling scale factor is a measure of the negative 
of the cross-partial second derivative of the cross-corre- 
lation function between the reference map and the ob- 
servation scene. 

6. The correlation tracker of claim 5 wherein said 
scale factors Ce(k), Cd(k) and Ced(k) are generated 
according to the relation: 


Ne Nd 2 
Cek)= = 2 We; 
i=1 j=1 


Ne 


Cck) = = NG wa? 
i=l j=l? 


Ne Nd 
Ced(k) = 2 ja We Way 


where Ne is the total number of pixels to be correlated 
along the first direction and Nd is the total number of 
pixels to be correlated along the second direction. 

7. The correlation tracker of claim 4 wherein said 
weighting functions are generated according to the 
relationship 


MAP; 1 {k—1)—MAP;_ 1 {k—1) 
Wefk) = 


— MAP, \(k—1)+MAP,;_\(k—1) 
Wafk) = — it aes ib 


where Ae and Ad are the respective dimensions of the 
pixels of said display along said first and second direc- 
tions. 

8. The correlation tracker of claim 4 further compris- 
ing a normalized error signal generator coupled to said 
scale factor generator and said correlation error signal 
generator whereby a first normalized error signal Se’ (k) 
is generated for frame k according to the relationship 


1 
1) — Gee 
CeCd 


Se’ (k) = Ee’ (k) 


where 
Ee’ (k) = Eek) ~ i Ed(k) 


and a second normalized error signal 5d(k) is generated 
for frame k according to the relationship 
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1 

—_—_—_——_———— Fd’ 

| eet 
CeCd 


Ced(k) 
Catk) 


8d’ (k) = 


Ed’ (k) = Ed(k) — Ee(k) . 


9. The correlation tracker of claim 4 wherein 1/w, is 
defined to be the number of frames of video input v,(k) 
which is effectively averaged in the reference map MA- 
P;Ak). 

oo The correlation tracker of claim 4 wherein the 
initial reference map is MAP,{1/w}) and is generated 
recursively according to the relation 


MAP,f{k) = (1—w,) MAP f{k—1) + wp Vifk) 


for 1=k=1/v, where 1/w, is an integer equal to the 
number of frames over which V 4k) is effectively aver- 
aged in the reference map MAP,{k). 

11. The correlation tracker of claim 4 wherein the 
map generator memory means comprises a register 
means for storing the most recently generated (Ne+ 1) 
X Nd pixel values of the reference map MAP;;in frames 
K—1 and k. 

12. The correlation tracker of claim 4 wherein the 
map generator memory means comprises a random 
access memory for storing the most recently generated 
(Ne+1) X Nd pixel values of the reference map MAP; 
in frames kK—1 and k. 

13. The correlation tracker of claim 4 further com- 
prising a normalized error signal generator coupled to 
said scale factor generator and said correlation error 
signal generator whereby a first normalized error signal 
5e’(k) is generated for frame k according to the relation- 
ship 


Be’ (k) = 


where 


Ee (k) = Ee(i) - SAR Bay 


and a second normalized error signal 5d(k) is generated 
for frame k according to the relationship 


1 
bf (_) = Ed” 
= Ced* 


Ed (k) = Bath) — HD rethy 

14. The correlation tracker of claim 13 further com- 
prising a drift compensator coupled to said normalized 
error signal generator for generating a first essentially 
drift-free video error signal Se,,,(k) according to the 
relation 


Se cork) = [Se'(k) + SepR(k) ] 


where Sepr(k) is recursively generated according to 
the relation 


8enr(k) = Sepr(k— 1+ w,5e'(k—1) 


and a second substantially drift-free video error signal 
§d.or(k) according to the relation 
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BdeorAk) = [8d'(k) + BdpplK)] 


where Sdppr(k) is recursively generated according to 
the relation 


Sdpr(k) = 8d pp(k= I+ w18a"(k—1). 


15. The correlation tracker of claim 14 wherein the 


map generator memory means comprises a register 19 


means for storing the most recently generated (Ne+ 1) 
-+ Nd pixel values of the reference map MAP;in frames 
k—1 and k. 

16. The correlation tracker of claim 14 wherein the 
map generator memory means comprises a random 
access memory for storing the most recently generated 
(Ne+1) X Nd pixel values of the reference map MAP; 
in frames kK—1 and k. 

17. The method of generating correlation tracking 
error signals from input electromagnetic video signals 
Vk) utilized to form one video frame k of a two-di- 
mensional image plane having coordinates (€,n) where € 
represents the elevation and 7 represents the azimuth 
said image plane defined by a plurality of pixels each 
having a discrete location (i,j) in the image plane along 
coordinates € and 4 respectively, said method compris- 
ing the steps of: 

(a) generating a reference map value for each pixel 

according to the relation 


MAP,{k) = (1—w) MAP{k—1) + wi Vik) 
where w, is a weighting value having a value O=w,=1, 
(b) storing at least one frame plus one line of refer- 
ence map values MAP;s 


(c) generating a first optimal weighting function 
Wek) according to the relation 


MAP, 1 {k—1)—MAP)_1{k—1) 
Wejfk) = oh 


where Ae is the dimension of each pixel in said image 
along the € coordinate; 
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40 


(d) generating a second weighting function Wdj{k) 45 


according to the relation 
Ms . ios --  (k—1 
Wak) = MAP jk Pict ) 


where Ad is the dimension of each pixel in said image 
plane along the 7 coordinate; 
(e) generating first, second and third adapative scale 
factors for each image plane frame according to the 
relationships 


Ne 


Cehk) = = Nd We;2(k) 
= e;i 
i=1 j=i * 


Ne Nd 2 
Caley = (2B, WaPo) 


Ne 
Ced(k) = . 2 
i= 


Nd 

2, Wait) Wek) 

j= 

where Ne is the maximum number of pixels along the € 
coordinate and Nd is the maximum number of pixels 
along the 7 coordinate; and 
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(f). generating first and second correlation error sig- 
nals Ee(k) and Ed(k) for each image plane frame 
accordingly to the respective relationships 


1 Ne Nd 
Ee(k) = aH i jal Wejfk) [V AK) — MAP {k— 1) 
1 Ne Nd 
Ed(k) = Cae , 2 j Z Waj<k) [Vifk)—MAP fk+ 1]. 


18. The method of claim 17 comprising the further 
step of generating first and second normalized correla- 
tion error signals 5e’(k) and 6d’(k) for each image plane 
frame k according to the respective relationships 


_ 1 _ Cedlk 
2) = ogy SER Batol. 
Cock CALE) 
_ 1 _, Ced(k) 
8d @) =~ cg — BO — “Cay BAP 
Ce(RNCALR) 


19. The method of claim 17 wherein 1/w, is defined 
to be the number of frames over which V;{k) is effec- 
tively averaged to generate the reference map values 


20. The method of claim 17 wherein the initial refer- 
ence map is defined to be MAP,{1/w)) and is generated 
recursively according to the relation 


MAP{fk) = (1—w1) MAP,{k—1) + w1Vif) 


for 1=k=1/w; where 1/w, is an integer equal to the 
number of frames over which V;{k) is effectively aver- 
aged to generate the reference map values MAP;Ak). 

21. The method of claim 17 further comprising the 
steps of compensating for drift in the « coordinate direc- 
tion to generate a first drift-free correlation error signal 
S€cor(k) according to the relation 


Becorhk) = [Be'(k) — SepR(K)] 


where Sep p(k) is recursively generated according to the 
relation 


Bdpr(k) = Sdpp(k—1) + w8d'(k—1) 


and compensating for drift in the n coordinate direction 
to generate a second drift-free video error signal 
8d.or{k) according to the relation 


BdeorAk) = [8d'(k) + Sdpg{k)] 


where 5dpp(k) is recursively generated according to 
the relation 


Bepg(k) = Sepp(k—1) + w8e'(k—1). 


22. The method of claim 21 wherein 1/w, is defined 
as the number of frames over which V Ak) is effectively 
averaged to generate the reference map values MA- 
P,{k). 

i The method of claim 21 wherein the initial refer- 
ence map is defined to be MAP,{1/w)) and is generated 
recursively according to the relation 


MAP fk) = (1—w,) MAPfk—1) + wy Vi<k) 
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for 1=k=1/w; where 1/w, is an integer equal to the 
number of frames over which V,{k) is effectively aver- 
aged to generate the reference map values MAP,{k). 
24. The method of claim 23 further comprising the 


20 
video signal pixel values, multiplying that differ- 
ence by the associated pixel weighting in said first 
coordinate direction to form a first set of error 
values and in said second coordinate direction to 


step of removing drift corruption from said correlation 5 form a second set of error values, accumulating the 
oe values to ili a first and a second drift-free corre- members of said first set of error values over each 
ation error signal. video frame and dividing the result by said first 
25. The method of generating correlation tracking adaptive scale factors tet a first correlation 
error signals from input electromagnetic video signals error value in said first coordinate direction and 
V Ak) utilized to form one video frame k of a two-di- 10 accumulating the members of said second set of 
mensional image plane having coordinates (€,7) where € error values over each video frame and dividing 
represents the leaton and 9 represent the rimuth the rent by sald Second adaptive scale factor fo 
having a discrete location (i,j) in the image plane along att ahi eae ae Se eC ee ee 
once eee method compris- 15 96 ‘The method of claim 25 further comprising the 
(a) providing a reference map value MAP; for each steps of : f : 
pixel representative of previous electromagnetic (a) Beneratng an adaptive cross-coupling scale facto: t 
signals Vk); representative of the negative of the cross-partial 
g > : . . . Z 
(b) storing at least one frame and one line of reference 20 second derivative in said first and second coordi- 
map values MAP, nate directions of the cross-correlation function 
(c) generating first and second weighting functions between the reference map pixel values and video 
representative of the negative derivative of the signal pixels summed over all pixels in said image 
reference map values in the € and 7 coordinate plare; and : . 
directions respectively; 25 (db) normalizing said first and second correlation error 
(d) generating first and second adaptive scale factors values utilizing said first and second adaptive scale 
said adaptive scale factors being representative of factor and said adaptive cross-coupling scale fac- 
the negative second derivative of the reference tors to eliminate cross-coupling components be- 
map in the € and 7 coordinate directions respec- tween said first and second correlation error values 
tively, between the reference map pixels and the 30 to form first and second normalized error signals. 


video signal pixels summed over all pixels of said 


27. The method of claim 26 further comprising the 


step of removing drift corruption from said normalized 
error signals to form a first and a second drift-free nor- 
malized error signal. 

* 


image plane; 
(e) generating correlation error signals along said € 


and 7 coordinates by generating the difference 
s ¢ & & 


between the reference map pixel values and the 35 
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